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ABSTRACT 

An experisent coapared three siethods of instruction 
in an introductory course in psychology. The first nethod utilized 
groups of three students and required that all three students aeet 
the criterion on each unit of aaterial in the course before being 
allowed to continue on to other units. This system also required that 
students do all renediation for other aenbers of the groups* giving 
ezaainationsr scoring exaninationSf and reporting ezaaination scores 
to proctors. This group was coapared with the standard Keller type 
coarse taught during the sane quarter and a third lecture course also 
taught the saae quarter. Perforaance was aeasured by final 
exaaination score and total points accuaulated in the course for all 
three groups. Results indicate that the group and the Keller group 
did not differ on perforaance aeasures but both groups perforaed 
better than the lecture group and rated the course acre favorably. 
(Author) 
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COMPARISON OF SM\LL-G{«DUP CONTINGENT MANAGEMENT WITII HE 
PEItSONALIZED SYSTEM OF INSTRUCTION AND THE LECTURE SYSTEM 
Dan 0. Coldcwayi Midiael Santowski, Ruth O'Brien, and Victoria Lagowski 

University of Illinois at Chicago Circle 
Tliis experiment conpared three methods of instruction in an introductory 
course in psychology. This first method utilized groups of thn?e students and 
rt^quired that all three students neet the criterion r each unit of material 
in the course before being alloived to continue on to other units. This system 
also i-cquired that students do all remediation for other members of the group, 
giving examinations, scoring examinations, and reporting examination scores 
to proctors. This groiq> was compared with the standard Keller type course 
taught during the same quarter and a third lecture course also taught the 
same quarter. Performance was measured by final examination score and total 
points accumulated in the course for all three groups. Results indicate 
that the experimental group and the PSI group did not differ on performance 
measures but both groups perfoimed better than tlie lecture group and rated 
the course more favorably. A discussion of the effectiveness of the exper- 
imental system and the economy of such a system follow. Advantages and 
disadvantages of the experimental instructional system are also discussed. 
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COMPARISON or SMALL-GROUP CX)\~; INQINCV MANACUEMENT KITH THE 
PliRSONAIJZED SYSTEM OE INSTRUCTION AND THE I£CrURE SYSTPAI 
Dan 0. Coldeway, Michael Santoivski, Ruth O'Brien, and Victoria Lagowski 

Ifiiiversity of Illinois at Chicago Circle 
Recent developments and research on individual inst motion models have 
mainly centered on the Keller plan (Keller, 1966) for use at the college 
level. Keller outlines five features of his plan \vhidi distinquishes it 
from other teaching procedures. A Keller course is (1) individually paced, 
(2) mastery oriented, (3) utilizes individual student tutoring or proctor ing, 
(4) uses printed materials as the source of information, and (5) uses lectures 
and demonstrations as vehicles of motivation rather than as the primary source 
of information. 

Although the effectiveness of the Keller system of instruction is well 
documented (Kulik, et. , al., 1974), a technology of teacliing (Skinner, 1968) 
need not necessarily strickly follow the Keller plan to be effective. 
Approaches to instiuction requiring students to attend discussions, laboratories, 
and lectures have prown to be effective (Postelthwaite , 1964). Systems of 
instruction without student pacing have also been effective (Malott, 1969; 
Coldeway, 1974). Ferster's interview method has been used by many instructors 
effectively (Ferstcr, 1966). The key factors which appear to be important in 
the effectiveness of instruction across systems are first, clear specification 
of what if expected of the student (usually in the form of instructional 
objectives), second, frequent assessment of student performance and feedback 
for improvement, third, the chance for remediation, and fourth, a set of 
criteria for student performance which represents mastery of relevant material. 



A system of instioictioh utilizing the above Key factors can take many 
fonna. The present experiment describes the design, ev«liuition, and comparison 
with other systems of instruction of a course utilizing small group pressure 
and group tutoring as a no .hod of producing student motivation and academic 
performance. The present experimental course was coirpared with a typical 
Keller plan course and the standard lecture-discussion course. The purpose 
of the present experiment was to investigate a system of instruction that 
v/ould increase student interaction, reduce the number of staff needed to run 
the course, and reduce the time needed to run the course while still producing 
effectiveness levels comparable to already well established Keller courses. 

MEIliOD 

Subjects . Tiventy-four students randomly chosen from 343 students enrolling 
in an introductory psychology course served as subjects. The subjects chosen 
had signed up for the same discussion section, reducing the need for changing 
their course schedules for participation in tliis experimental group. All 
24 students were told in their discussion section meeting on the first day 
of the quarter not to attend lectures and ?neet in a seperatc room during the 
regularly scheduled lecture hour. 

TVo control groiAps were also randomly chosen from the original enrollment 
of 343 students. Thirty- five students were selected from the lecture part 
of the course and thirty students were assigned to a personalized system of 
instruction course (Keller, 1966). 

Procedure . Students assigned to the small-group system \^erc first divided 
into groiqjs of three students. Students were allowed to form their own groups 
if they chose, and the remaining students were randomly divided into groups of 
three. Each group was then assigned an undergraduate student proctor. Three 
proctors were used, two having three groups of students to monitor and one 



having only two jjl'oups of students. 

Immediately following the forireition of groups, students were handed 
policies and procedures instructions. These instructions specified that when 
each member of a particular graup was ready to take a unit examination, the 
group was required to take that examination all at the same time. Lach 
groifl) was responsible for the progress of all its meniiers. If one of the 
ntcn^ers did not pass a unit examination, the rest of the meirfjers were respon- 
sible for helping that member and giving that meirber the . t equivalent form 
of the unit examination, scoring that examination, and rcpc ing the menbers 
performance to the proctor in charge of the group, until tb-^^ student mastered 
that unit of material, therefore, the progress of the groiip through the units 
of material was dependent upon the progress of each menfcer of a particular 
groiq?. No meirber of a group could take the next unit examination until all 
the members of the group had met the criterion on the previous unit. 

Each group was also responsible for scheduling their unit examinations. 
A contract system was used between the members of the groiqp and tlie proctor. 
The contract specified when the next examination would be taken by the entire 
group. If the contract was broken by any of the group meirbers the examination 
was postponed until a new groi^ contract could be made. 

The criterion for mastery of a unit examination was 90^ . IVhen a 
group mastered a unit examination, each member was given a form of the 
objectives for the next unit, and a contract was made for the next unit 
examination. If one or more members of the groijqp did not master a particular 
unit examination, the members of the grotp decided when remedial examinations 
would be given by ths menbers already at mastery on that unit. 

Vihen all members of a group had completed a unit examination, it would 
be corrected with the proctor and all the group members present. Tlie students 
would report their answers to the questions verbally and discussion was 



encouraged. If any menibers had incorrect answers the other members of the 
gtx>up wei*e encouraged to help that merlier with the problem, all the 

questions had heen scored the proctor indicated to each member whether ho 
had passed or failed that exandnation. 

The PSI control group was put into a Keller plan course on tlie first 
day of the quarter. These students were assigned an undergraduate student 
proctor and also given policies and procedures instructions that described 
the basic Keller type course. These students were free to work individually 
and at their oivn pace through the units of material . The only restriction on 
pacing was that they must conplete the first four units of materials by the 
end of the sixth week or they would be asked to withdraw from the course. 
These students vrere also told that incompletes would not be given and units 
not completed by the end of the quarter would reduce the nuntoer of total 
points they could earn. 

The third group of lecture students were a part of a larger lecture 
section of the course taught at the same time as the small-groiip course and 
the PSI control course. Students in the lecture group attended a 50 minute 
lecture three days a week given by the faculty menber in charge of the course. 
Students in this groiq) also took two midterm examinations during the fifth 
and eighth weeks of the quarter. Both midterms were multiple choice 
examinations, with 50 questions on each examination. Students in this group 
received the number of correct answers as their midterm scores, a criterion 
for performance was not set and students could not remediate. 

Procedures common to all three groups . Students in all groups used the 
same text ( Introductory Psychology , Individual Learning Systems, 1973) 
and were required to read the novel I Never Promised You a Rose Garden , by 
Hannah Green as the last unit of material covered in the course. Students 



in all groups were given objectives covering all laiits ot material in the 
course. Tlie objectives were written by the first author anil tested on unit 
examinutions and on the midterms given to the lecture groi^. 

Students in all three goups could cam additional points by doing 
some or all of the following optional assignments (see table 1). First* 
students in any group could earn 4 points for each experiment participated 
in up to a maximum of 20 points. Second, students could earn 2 points for 
each discussion section they attended. Discussion sections were conducted 
by graduate assistants and designed to let students experience psychological 
procedures first hand. No information from the text or lectures was covered 
in the discussion sections. Third, students could earn additional points 
by successfully wrriting and handing in two abstracts covering articles 
they had rca (5 points per abstract) and also by writing and handing in 
an experimental proposal by the ninth week of the quarter (10 points maximum) . 
Written assignments were graded and returned by the graduate assistants. 
Rewrites were allowed if students handed in the assignments by the deadline 
dates. Finally, all students took a comprehensive final examination during 
the eleventh week of the quarter. The final examination was 75 questions, 
multiple-choice, and covered all the units plus the novel. No questions 
from the unit examinations or midterm examinations were used on the final 
examination. 

Grading was dependent upon a point system (see table 1) . Table 1 
shows the grade scale that was used for all three groups of students. 



Insert Table 1 about here 



Tlie snuill-p.rom^) system .-uid the PS I ftroiip could cam a niaximiun of 100 points 
for coni|)lotion of all unit examinations at the specified mastery criterion. 
The midtcnn examinations taken by the lecture group were worth 50 points 
each. 

RESULTS 

The data were analyzed using a pi ..jied comparison model. Inis analysis 
compared the performance of the small- group system with the PSI group and 
the coirbined performances of the small-group system plus tlie PSI group with 
tlie lecture group. 

'fhe comparison of the small -group system with the PSI group found to 
be non-significant (F = 1.27, 1, 86 df; p>>.45) using the nuirher of points 
earned on the final examination as the dependent variable. The mean final 
examination score for the small -group system was 63.54 in comparison to 
a mean score of 62.93 for the PSI group. The same comparison was also made 
between the small-group system and tne PSI group using total points accumu- 
lated in the course as the dependent variable. This difference was also 
found ro be non-significant (F = 1.94, 1, 86 df; p>..25). The mean total 
points accumulated for the small-groiip system were 202.66 and the points 
accumulated for the PSI group were 195.65. 

The compaiison of the conbined perfonnance of the small-groiq) system 
and the PSI group with the lecture group, using the final examination score 
as the dependent variable, indicated a significant difference (F = 5.25, 
1, 86 df; p <.05). This difference indicatea that the combined perfommccs 
of the small -group system and the PSI group on the final examination was 
higher than the performance of the lecture groip on the final exjwiination 
(mean final examination for small- groiq;) and PSI * 63.235; mean final examin- 
ation score for lecture - 56.552), 



Tlic coin|>arison of the combinctl pcrfonnance oF the small-jiroiip system 
and the VSl group with the lecture group itsing the total points accumulated 
in the course as the dependent variable indicated a significant difference 
(F » n.34» 1, 86 df; p <..01). Both the small -group system and the PSI 
group accimulated significantly more points in the course than did the lecture 
group (mean points accutmilated for groups small-group and PSI ■= 198.84; mean 
points accumulated for Icctui-e = 178.85). 

Tlie grade distributions for all three groups arc shoivn in figure 1. No 
student in the small-group system received lowr than a C grade and there 
;verc no students withdrawing from tliis groiq). The PSI group showed a similar 
grade distribution as the small-groups system. Hoi*ever, one student in this 
group did receive a 'D' grade and seven students withdrew from the PSI group 
before the end of the sixth week of the quarter. All seven of the students 
withdrawing from the PSi group were behind the pace of the majority of the 
PSI students and were asked to drop the course for that reason. The gnide 
distribution for the lecture group was considerably different from the small - 
groups and PSI distributions . Less than 50% of the students received 'A' 
grades with four students receiving 'D' grades and one student receiving a 
failing mark in the course. Only 3 students withdrew from the course. All 
three students withdreiv before the end of the sixth week of the quarter with- 
out instructions from the course staff to do so. 



Insert Figure 1 about here 



Students in all three groi:q)s were asked to fill out the Illinois Course 
Evaluation questionnaire (Aleamoni, 1972) during the eleventh week of the 
quarter. The mean rating and decile ranking of each siibscore categpry on 
the Illinois Course Evaluation questionnaire are presented in figure 2. 



A conii>arison of all three groups mvin averages with mwm averages from intro- 
ductoiy courses taught in the United States was computed, llic snuill-groups 
system and PSl group both rated the course higher than the USA average rating 
(X^^^ « 3.14; Xyg^ = 2.88i t = 3.11, 10 df; p .01: Xpc^i 3.09; - 2.88; 
t «= 2.89» 10 df; p <^.05). Ihc lecture group and IKA ratings were not signi- 
ficantly different. 



Insert Figure 2 about hei-e 



Written comrtents by the students on the Norr- Crittenden teacher evaluation 
questionnaire were also obtained during the eleventh week of the quarter. 
Ninety percent of the small -group system students wrote in coiianents. ^tost 
of the comments were favorable and centered on the students high ratings of 
objectives, frcciuent examinations, and a chance to work with other students. 
Some of the students commented that the group pressure was sometimes a- ^rsive, 
especially when they were busy with other courses. 

Eighty-six percent of the PSI students wrote in comments on the Norr- 
Crittenden teadier evaluation form. Tlie majority of these comments were 
also favorable and centered around the students high rating of the objectives, 
frequent testing procedures, individual pacing, and content of the course in 
general. Some students complained about a lack of student -teacher interaction 
and the fact that there was not much chance for groq> discussions on course 
material . 

Sixty- five percent of the lecture students wrote in comments on the 
Norr-Crittenden teacher evaluation form. The majority of these comments 
were not favorable to the course procedure. Students complained about having 
to attend lectures, about the lack of feedback on examinations, and about the 



hijjh levol criterion noeilod to rc^nch ;m 'A' grade. However, ;tuJents in 
this group did coment favorably on the course content and discussion sections. 

DISCUSSION 

llic ixjsults oF tlie present experiment clearly indicate that tlic course 
utilizing small grou^i contingencies and group contracting pcrfoimed equally 
as well as a standard Keller type course and significantly better than a 
traditional lecture style course. Althcugh the total points {ind therefore 
grade distributions for the small -groups and PSI courses are higher them those 
of the lecture course, this variable in partially confounded because of the 
greater availability of points for the small-groups and PSI groups due to 
remediation on unit examinations. Lecture student**, could not remediate mid- 
term examinations and were forced to receive only the nuii4)er of points they 
earned by taking each midterm the first time. 

However, the analysis of the final examination scores clearly shoivs 
that both the small-groups system and the PSI group did retain considerably 
more of tlie course material than did the standard lecture group. Because 
the questions included on the final examination had not previously appeared 
on midterm examinations or unit examinations, it appears that the final 
examination scores do represent the amount of material retained by students. 
However, tlie level of learning attained by students is not indicated by their 
final examination score or total points accumulated. A post-hoc analysis of 
the final examination questions indicates that approximately 85^^ could be 
considered to be measuring memory level skills while only 151 could be considered 
to be measuring Idgher cognitive (conceptual) skills (Anderson, 1973; Markle 
and Tiemann, 1969). Previous research has sham the error rates on conceptual 
level questions to be higher than on memory level questions regardless of tho 
level of motivation or contingencies put on student's behavior (Coldeway, 1974). 



Tlici*croro, the data obtainoJ Crom the present experiment cannot be interpreted 
to indicate tlui; tl»o s)nall'gron|->n system or I'Sl gioups would have performed 
better tban the lecture f.roup if tite majority of the objectives wcix? concep- 
tual in nature (Cagtie, 1974). 

Ibe responses by students on the Illinois Course Kvaluation quest ionnaii*c 
clearly show that the 'jinall- groups systems students rated the course highly in 
comparison to the United States averages for introductoiy courses and in 
con?)arision to the lecture group in the present experiment, 'flic hipji ratings 
also suggest that the students did not find the peer pressure or group contin- 
gencies strongly aversive. However, comments written by the small-[|roups 
systems students did indicate some problems with the group contingencies 
when particular meirbers of a group had conflicts with other courses. In 
addition, two of the groups had to be reorganized early in the quarter when 
meirbers of these gioups complained to their proctor that not all the group 
mentoers wished to vfork at tlie same pace through the course miiterials. Roth 
groups wore allowed to reorganize to provide for more compatibility among 
the group menders. 

The zero level withdrawal rate in the smjill -gix>ups system is especially 
encouraging given previous reports of PSl courses with up to 15?i withdrawal 
rates (Kulik, et., al., 1974). The high course evaluations and added peer 
pressure in this group can be hypothesized for keeping students enrolled in 
the course. However, the high ratings of the subject matter and course content 
by all tbree groups suggests that this factor aided in keeping the withdrawal 
rate low in all three groups. 

One of the primary reasons for including the small groups variable in 
the experimental groiqo i^fas to determine if that variable would increase 
student interaction and discussion, rhe observation of proctors working 



with the cxpcri^nental group indlcatos that students in this group were often 
observed discussing the course materials outside the testing area. Tlie 
proctors also report that students in the experimental group would often begin 
discussions with them about iiiatcrial covered in the course or other topics in 
psychology related to the course content. Observations of the other two 
groups (PSI and Lecture) by proctors and the instmctor did not indicate tliat 
students in these groups spent imch time interacting xvith each other or in 
discussions of course material. 

Another varit'ible relevant in tl\is experiment was the economy of each 
particular system of iiiStruction. Hie experimental procedure required fewer 
proctors per studen*: and the contracting for unit examinations reduced the 
tin^e proctors spent waiting for students to complete examinations. Proctors 
in the small -groups system could schedule examinations, leaving adequate 
time for correcting the examinations and discussion of important points. 
Students in the small-groups system also profited by the contracting system. 
Each student in this group xvas always assured that a proctot would be available 
for correcting the examination whenever the group was completed xvith the 
examination. Students did not have long waiting periods ns was often the 
case in the standard PSI group. 

Requiring that members of groups be responsible for remedial examinations 
also produced some important effects. Students already passing a particular 
unit examination would assist a fellow group member who did not pass in 
understanding the material more completely for the next form of the examination 
The students who had already passed the unit examination would also give the 
remedial examinations, freeing proctors for discussions and record keeping 
tasks . 



Although the overall effectiveness of the cx|)eriinen'. al course wjis 
goocl in the present cxperiiiient, some problems with this systcmof instruction 
could develop if this system of instruction was used with a larger nuiriier of 
students. The potential for cheating is increased when students arc required 
to examine each other, especially when the contingencies specify that the 
group cannot go on until all the meiiibers have met the criterion. Furthcnnorc, 
the rearrangement of groins on a large scale could cause problems not encountered 
in the present study. An excess nun4>er of students may wish to go fast through 
the materials leaving only few students wishing to proceed at a slower pace. 
The formation of groiqps of compatible students may be more difficult and maybe 
even impossible. It is doubtful tint groups larger than three would be as 
efficient although groups of two could work if necessary. 

It is important to note that the present experiment used conpetency 
based evaluation rather than normative based evaluation. A system utilizing 
groins of students who were graded on "tlie curve" could cause problems and 
conflicts between students . It is doubtful that such a system would produce 
increased student interaction or increased student performance. However, the 
interaction of several variables involved in the small groups method needs 
to be further investigated before any firm conclusions can be made about tlie 
overall efficacy of such a system. 
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